Neural Network Ensembles
نویسندگان
چکیده
We propose several means for improving the performance and training of neural networks for classification. We use crossvalidation as a tool for optimizing network parameters and architecture. We show further that the remaining residual “generalization” error can be reduced by invoking ensembles of similar networks. Zndex Terms-Crossvalidation, fault tolerant computing, neural networks, N-version programming.
منابع مشابه
Ensemble strategies to build neural network to facilitate decision making
There are three major strategies to form neural network ensembles. The simplest one is the Cross Validation strategy in which all members are trained with the same training data. Bagging and boosting strategies pro-duce perturbed sample from training data. This paper provides an ideal model based on two important factors: activation function and number of neurons in the hidden layer and based u...
متن کاملCascade Ensembles
Neural network ensembles are widely use for classification and regression problems as an alternative to the use of isolated networks. In many applications, ensembles has proven a performance above the performance of just one network. In this paper we present a new approach to neural network ensembles that we call “cascade ensembles”. The approach is based on two ideas: (i) the ensemble is creat...
متن کاملEnsemble of GA based Selective Neural Network Ensembles
Neural network ensemble is a learning paradigm where several neural networks are jointly used to solve a problem. In this paper, e-GASEN, a twolayer neural network ensemble architecture is proposed, in which the base learners of the final ensemble are also ensembles. Experimental results show that e-GASEN generalizes better than a popular ensemble method. The reason why e-GASEN works is also di...
متن کاملArtificial neural network ensembles and their application in pooled flood frequency analysis
[1] Recent theoretical and empirical studies show that the generalization ability of artificial neural networks can be improved by combining several artificial neural networks in redundant ensembles. In this paper, a review is given of popular ensemble methods. Six approaches for creating artificial neural network ensembles are applied in pooled flood frequency analysis for estimating the index...
متن کاملExtracting symbolic rules from trained neural network ensembles
Neural network ensemble can significantly improve the generalization ability of neural network based systems. However, its comprehensibility is even worse than that of a single neural network because it comprises a collection of individual neural networks. In this paper, an approach named REFNE is proposed to improve the comprehensibility of trained neural network ensembles that perform classif...
متن کاملIs it worth generating rules from neural network ensembles?
Although many authors generated comprehensible models from individual networks, much less work has been done in the explanation of ensembles. DIMLP is a special neural network model from which rules are generated at the level of a single network and also at the level of an ensemble of networks. We applied ensembles of 25 DIMLP networks to several datasets of the public domain and a classificati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Pattern Anal. Mach. Intell.
دوره 12 شماره
صفحات -
تاریخ انتشار 1990